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EXPERIMENTAL DESIGN FOR COMPLEX SYSTEMS 
William D. Heavlin 

5 BACKGROUND OF THE INVENTION 

1. Field of the Invention 

This invention relates generally to the manufacture of high performance 
semiconductor devices. More specifically, this invention relates to a systematic approach 
to an experimental design for large, complex systems. Even more specifically, this 
10 invention relates to a method for systematically designing experiments when prior 

knowledge of the many factor and multiple responses is expressed as a network of cause- 
l g effect relationships . 

^ ^ 2. Discussion of the Related Art 

r 

f 5 The design of a new semiconductor device and the process for manufacturing the 

« 15 new semiconductor device has three phases: the development phase during which 
i^i processing alternatives are still under evaluation and the nominal process targets continue 

H to be tuned; the pre-production phase during which the process targets are more-or-less 

i fl 

set, processing experience is acquired, and appropriate tolerance windows are determined; 
M and the production phase during which both the process target and tolerance windows are 

20 more-or-less fixed, and the full resources of the manufacturing line are committed in 

volume. The present invention focuses on the pre-production phase during which process 
targets are substantially set, but process experience is to be accumulated, and during which 
appropriate tolerance windows need to be determined. 

The pre-production phase plays an essential role in managing the manufacturing 
25 risk factor, providing a time period for determining problematic and challenging process 
steps, for investigating the range over which product can be manufactured successfully, 
and for reliability stress testing. The scale of current semiconductor manufacturing 
processes magnifies all of the issues, for example, contemporary semiconductor processes 
have 300-400 value added steps, any of which is a source of poor quality and/or reliability. 
30 A cost of a single test batch can exceed one quarter million dollars. A delay in market 
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entry equal to one cycle of learning (the production time required to make one batch) 
approaches two orders of magnitude more. 

Competitive pressures have provided strong incentives to keep pre-production 
costs to an effective minimum. In the statistics literature, it is well recognized that 
5 appropriately designed experiments more fully characterize processes than, for example, 
multiple repetitions of the nominal process. The pre-production assessment of a new 
semiconductor manufacturing process typically involves many factors and can be from 30 
— 50 and sometimes more, multiple blocks, typically from 5 — 15 blocks, and several 
responses, typically from 3-8 responses. One practical constraint is for each 
10 experimental block to be self-contained, in the sense that each block supports an analysis 
without necessarily requiring results from other blocks. A complementary goal has the 
entire ensemble of experimental blocks covering the process space well. Subject matter 
expertise is both available and desirable and can be organized as a network of likely cause- 
effect relationships. 

15 The present invention thus presents a systematic approach to the pre-production 

problem, including objectives, constraints, overarching model, blocking structures, split 
and skew factors and self-containing blocks. 

SUMMARY OF THE INVENTION 

According to the present invention, the foregoing and other objects and 
20 advantages are achieved a systematic approach to forming experimental designs for large, 
complex systems after an idea for a product is formed. In accordance with a first aspect of 
the invention, critical variables for the product are determined by experts in the field, a 
design matrix Uk is defined, a base design matrix X is generated, Y(P) =(I-B(B^B) *B^)[X 
P)//U]A & Wynn's criterion is defined, where P is a permutation matrix, I is an identity 
25 matrix, B is a blocking matrix, B^ is a transposed matrix of B and A is a matrix composed 
of causal map-base coefficients and wherein a design matrix Uk is created. The index k 
^k+1 is set and an algorithm to choose the best of random column permutation matrices P 
and an algorithm to choose the best column permutation matrix P that is near a previous 
solution and settin Uk^[X P*" with rows from Uk.i appended]. 

30 In accordance with another aspect of the invention, it determined whether the 

design Uk is large enough and if not the process described above is repeated until the 
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design Uk is large enough. If it is determined that the design Uk is large enough protype 
products are manufactured, model responses are determined from the prototype wafers and 
determining whether the model responses are adequate. 

In another aspect of the invention, if the model responses are adequate, tolerances 
5 for the product are assessed and proposed. If the tolerances assessed and proposed are 
manufacturable, the product is passed to full-scale production. 

In another aspect of the invention, if the model responses are not adequate, the 
experimental design is repeated to create further Uk. This procedure is repeated until a 
design Uk is achieved that indicates that the model is adequate. 

In another aspect of the invention, if the tolerances assessed and proposed are not 
manufacturable, the design experiment is repeated until a design Uk is achieved that 
provides a manufacturable product. 

The described invention thus provides a method for a systematic approach to 
forming experimental designs for large, complex systems after an idea for a product is 
formed. 

The present invention is better understood upon consideration of the detailed 
description below, in conjunction with the accompanying drawings. As will become 
readily apparent to those skilled in the art from the following description, there is shown 
and described an embodiment of this invention simply by way of illustration of the best 
mode to carry out the invention. As will be realized, the invention is capable of other 
embodiments and its several details are capable of modifications in various obvious 
aspects, all without departing from the scope of the invention. Accordingly, the drawings 
and detailed description will be regarded as illustrative in nature and not as restrictive. 

BRIEF DESCRIPTION OF THE DRAWINGS 

25 The novel features believed characteristic of the invention are set forth in the 

appended claims. The invention itself, however, as well as a preferred mode of use, and 
further objects and advantages thereof, will best be understood by reference to the 
following detailed description of an illustrative embodiment when read in conjunction 
with the accompanying drawings, wherein: 
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Figure 1 is a flow diagram showing the steps for the development of a 
semiconductor device from the "Idea for a Product" to the "Production" of the 
semiconductor product; 

Figure 2 is flow diagram showing the steps for the pre-production phase of the 
development of a semiconductor product; 

Figure 3 is a diagram of a Causal-Effect Diagram; 

Figures 3A - 3G are sub-diagrams associated with the Causal - Effect Diagram 
shown in Figure 3; and 

Figure 4 is a causal map derived from information contained in the Causal-Effect 
Diagram shown in Figure 3. 

DETAILED DESCRIPTION 

Reference is now made in detail to a specific embodiment or specific 
embodiments of the present invention that illustrate the best mode or modes presently 
contemplated by the inventors for practicing the invention. 

Figure 1 is a flow diagram 100 showing the steps for the production of a 
semiconductor device from the initial "idea" for the semiconductor device through the 
production of the semiconductor device. The first step is the generation of an "Idea for a 
Product" Figure 1, Step A, 102, The next step is the "Initial/Further Development of 
Idea" that comprehends gathering data associated with the desired product. Figure 1, Step 
B, 104. The next step is to "Design/Refine Experiment" Figure 1, Step C, 106 and as 
indicated by the arrow 108 the flow goes to Figure 2 Step A, Figure 2 is a flow diagram 
200 showing the steps for the pre-production phase of the present invention and will be 
discussed below. After the pre-production phase shown in Figure 2 is completed the flow 
returns to the flow diagram 100 as shown by arrow 110. Prototype wafers manufactured 
using designed experimental values are evaluated at 112. The responses from the 
prototype wafers are empirically measured and mathematically modeled at 114. It is 
determined at 116 whether the response models are adequate. If the response models are 
not adequate, the flow returns to Figure 2, Step I as indicated by arrow 118. If the models 
are adequate, the next step at 120 is to assess and propose tolerances. It is determined at 
122 if the proposed tolerances can be manufactured. If the proposed tolerances can be 
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manufactured, the designed wafers are sent into production at 124. If the proposed 
tolerances cannot be manufactured, the flow is returned to Step B as indicated by the 
arrow 126. 



Figure 2 is a flow diagram 200 showing the steps of the pre-production phase of 
the present invention. Arrow 202 indicates the flow from Step C, Figure 1. Referring to 
Figure 2, Step A, the critical variables for the product and for the manufacturing of the 
product are determined at 204. The critical variables are determined by experts in the 
relevant art, in this case, the semiconductor manufacturing art. As an example, the experts 
determine that the following factors would be the critical variables for the proposed 



10 semiconductor product: 

I. Speed 
3. Vth 

5. Gate Resistance 
7. Leff 
15 9. LDD 

II. PolyDelW 

13. RTA sd (rapid thermal anneal s/d) 

15. ScreenOx 

17. spacer Thk 
20 19.PolyThk 

21. s'cide Rs (silicide resistance 

23. CD control 

25. G stp 

27. xface s/d Rc 
25 29. s'cide pen 

31.RpdepThk 

33. spacer c/e 

35.CO Thk 

37. VNWPI 
30 39, G R'cle (Gate reticle) 

41. G Mask QT 

43. 12 damage 

45, nitrideDep (nitride deposition) 
47. LI etch recipe (local interconnect 
35 etch recipe 

49. LI align (local interconnect alignment) 

50. LIo/e 51 
52. BMD DepThk 53 



2. N2P 

4. Gate Oxide 
6. R s/d 
8. LDC 

10. S/D Rs (Source/Drain resistance) 
12. lox 
14. DopLoss 
16. spacer 
18. spacer Ent 
20. G Dopant (gate dopant) 
22. Act Length 

24. SiON Strip (silicon oxynitride strip) 
26. LI bot CD 
28. Co QT 
30. G N2.I2 
32. LI DI CD 

34. s'cide RTA (silicide rapid thermal anneal) 
36. XterW (transistor width) 
GateOx QT 

SiON Dep (silicon oxynitride deposition) 
42. Trim Time 
44. UDOXthk 

46, polishThk (polish thickness) 
48. LI Thk (local interconnect thickness) 



BMD PCII 
RPE o/e 



38 
40 



Generating such lists of responses and factors is a common part of experimental 
40 design practice. At one end of the experimental spectrum are small experiments and short 
lists of expecially important variables (responses and factors). Because there weren't 
efficient experimental methods to incorporate larger numbers of variables, complex 
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systems with larger numbers of variables could not be efficiently designed. The present 
invention provides a method of efficiently designing larger more complex lists of 
variables. The ability of efficiently designing experimental designs for the larger more 
complex lists of variables is the major value of the present invention. 

5 Using the above-listed critical variables, a classical causal network diagram is 

created, Figure 2 Step B, 204. The terms "cause-effect diagrams," "causal networks," and 
"causal maps" are used in various ways in the relevant art. A cause-effect (or CE) diagram 
consists of a single response (at the head of a central backbone), major factor groups (as 
spines branching from the backbone), and lower level factors (off each spine), and perhaps 
10 branching off from other low level factors. In modem terms, CE diagrams render causal 
relationships as a strict hierarchy, with the response as the root node, factor groups as the 
C3 primary branches and other branches expanding therefrom. Causal networks are 

generalizations of CE diagrams, with three extensions: (1) the number of responses can be 
more than one, (2) responses can point causally to other responses, and (3) each factor is 
15 represented as one and only one node, even though it may contribute to various other 
responses and/or to higher-level factors. With newly introduced semiconductor 
I manufacturing processes, transistor characterizations have about F=50 factors (F denotes 

C 3 the number of factors of interest) and Fi is about 8 (Fi is the number of factors feasible to 

i J 

ll^ vary in any single block), the corresponding causal networks are complicated. For this 

r ~ 

- ^ 20 reason, causal networks are transformed into causal maps. 



r : ; 
— ■cr 
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The transformation of causal networks into causal maps involves the following: (i) 
the distance between any pair of nodes of a causal network is the minimum number of 
links of the path connecting them (this is shown below in the intemode link-count distance 
matrix); (ii) the corresponding matrix giving the distances between any pair of nodes is the 
25 natural input data structure for multidimensional scaling; and (iii) using a 

multidimensional scaling algorithm, such as XGvis (Buja et al. 1998) wherein the distance 
matrix is transformed into node coordinates in D = 2 dimensions. 

Causal maps that are constructed in this way have extra information that causal 
networks do not: (1) a factor closer to a response node plausibly has a stronger effect; (2) 
30 two factors close together likely share an interaction; (3) responses sharing many factors 
cluster; and (4) higher-level factors tend toward the map center. 
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The causal network diagram created using the critical variables is shown in 
Figures 3 & 3A - 3G. Establishing which critical variables affect other factors creates the 
causal-effect network. A causal-effect is in the form "cause => effect.*' Some of the 
critical variables are established as "higher-level responses" and are shown enclosed in 
boxes. Responses shown in Figure 3 are "Leff ' at 302, "R s/d" at 304 and "Vth(long)" at 
306. The sub-diagrams shown in Figures 3A - 3G show some of the critical variables 
shown in Figure 3 with additional critical variables "pointing" to them. For example, a 
critical factor "poly delta W" shown at 308, Figure 3 is shown in Figure 3A with three 
arrows from critical variables pointing to it. It should be noted that the critical factor 
"poly delta W" is therefore a response because other critical variables affect it (the number 
of arrows that are directed toward it), for example, the critical factor "poly delta W" as 
shown in Figure 3A has 3 arrows directed towards it directly and 5 arrows directed to 
another critical factor "CD control" 310 and an arrow from the critical factor "CD control" 
310 is directed to the critical factor "poly delta W." Some of the critical variables that are 
identified as responses, such as the response "poly delta W" are termed "intermediate 
responses." 

The next step is to create an Intemode Link-Count Distance Matrix, Figure 2, 
Step C, 208. Table 1 is an "intemode link-count distance matrix." The values in the 
matrix are derived by counting the least number of links from any one node of a factor or 
response any to any other factor or response in a causal map as shown in Figure 4. For 
example, the intemode link-count distance "1" from the factor "speed" to the factor "N2P" 
is obtained by counting the link from the factor "N2P" to the factor "speed." Similarly, 
the intemode link-count distance "2" from the factor "speed" to the factor "Vth" is 
obtained by counting the link from the factor "Vth" to the factor "N2P" and the link from 
the factor "N2P" to the factor "speed." The other matrix elements are derived in the same 
manner. 



INTERNODE LINK-COUNT DISTANCE MATRIX 
TABLE 1 





1 Speed 


2N2P 


3Vth 


4 Gate 


5 Gate ' 


" 51 BMD 


BMD 


RPE 


Factors (F) 








Ox 


R 


PCII 


DepThk 


o/e 


1 Speed 


0 


1 


2 


2 


1 


4 


4 


4 


2N2P 


1 


0 


1 


1 


2 


3 


3 


3 


3 Vth 


2 


1 


0 


1 


3 


4 


4 


4 


4 Gate Ox 


2 


1 


1 


0 


3 


4 


4 


4 


5 Gate R 


1 


2 


3 


3 


0 


4 


4 


4 


6Rs/d 


2 


1 


2 


2 


3 


2 


2 


2 
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7Leff 
8LDC 
9LDD 
lOS/D Rs 
5 llPolyDelW 
12I0X 

13 RTAsd 

14 DopLoss 

15 ScreenOx 
10 16 spacer 

1 7 spacer Thk 

1 8 spacer Ent 

19 PolyThk 

20 G Dopant 
15 21s'cideRs 

22 Act Length 

23 CD control 

24 SiON strip 

25 G stp 

20 26LIbotCD 



2 


1 


2 


2 


3 


4 


4 


4 


3 


2 


1 


2 


4 


5 


5 


5 


3 


2 


3 


3 


4 


3 


3 


3 


3 


2 


2 


3 


2 


3 


3 


3 


3 


2 


3 


3 


4 


4 


4 


4 


4 


5 


5 


6 


3 


4 


4 


4 


3 


2 


1 


2 


3 


4 


4 


4 


4 


3 


3 


4 


3 


4 


4 


4 


3 


4 


4 


5 


2 


3 


3 


3 


3 


2 


3 


3 


4 


3 


3 


3 


4 


3 


4 


4 


5 


4 


4 


4 


4 


3 


4 


4 


5 


4 


4 


4 


4 


3 


2 


3 


5 


4 


4 


4 


3 


2 


1 


2 


4 


5 


5 


5 


2 


3 


3 


4 


1 


3 


3 


3 


3 


2 


3 


3 


4 


3 


3 


3 



27 xface s/d Rc 

28 Co QT 

29 s*cide pen 

30 G N2.I2 
25 31 RpdepThk 

32 LI DI CD 

33 spacer c/e 

34 s'cide RTA 

35 Co Thk 
30 36 XterW 

ill 37VNWPI etc. 

38 GateOx QT 

39 G R'cle 

40 SiON Dep 
35 41 GMaskQT 

42 TrimTime 

43 12 damage 

44 UDOXthk 

45 nitrideDep 
40 46 polishThk 

47 LI etch recipe 

48 LI Thk 

49 LI align 

50 LI o/e 
45 51 BMDPCII 

52 BMD DepThk 

53 RPE o/e 



When the Intemode Link-Count Distance Matrix is determined, the next step is to 
50 apply a multidimensional scaling algorithm to create a D-dimensional (D typically 2 or 3) 
set of node coordinates called a causal map. Especially when D = 2, one can plot the 
nodes as points on rectangular graph paper, and so both the coordinates themselves and the 
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sesulting graph 400, Figure 4 are called causal maps. One example of a multidimensional 
scaling algorithm is XGvis. Its application to visualizing networks is known and is 
conventional practice. 

The next step is to create a Causal Map, Figure 2, Step D, 210. Figure 4 shows 
the Causal Map 400 derived from information contained in the causal network shown in 
Figures 3 & 3A - 3G and from information contained in the Intemode Link-Count 
Distance Matrix, Table 2. 

Once the Causal Map is determined, the next step is to Identify Response Nodes, 
Figure 2, Step E, 212. An inspection of the Causal Map 400, Figure 4 shows that the key 
responses move towards the center and are R s/d, n and p, at 402, Vth, n and p, at 404 and 
Leff, n and p, at 406, It is noted that part of the selection of key responses is the exercise of 
engineering judgment and additional selections or alternate selections could be made. 

After the values in Table 1 are determined and after the Key Responses are 
determined the next step is to calculate the Map-Based Coefficients aij. Figure 2, Step F, 
214. Table 2 shows the Matrix A (columns Vth n to Leffp of Table 2 make up Matrix A) 
with values aij derived from information contained in Table 1 & Figure 2, Step F, at 214, 

The following example shows how the values in Table 2 are calculated. Suppose 
the causal network has factors f 1, f2, and f3 all pointing to response rO having values 
determined from a similar Intemode Link-Count Distance Matrix as shown in Table 1. 
The portion of the intemode link-count distance matrix is: 





rO 


fl 


f2 


f3 


rO 


0 


1 


1 


1 


fl 


I 


0 


2 


2 


f2 


1 


2 


0 


2 


f3 


1 


2 


2 


0 



The causal map coordinates in 2 dimensions (D = 2) are approximately: 





diml 


dim2 


rO 


~ 0 


0 ~ 


fl 


1 


0 


f2 


-0.5 


0.866 


f3 


-0.5 


-0.866 



Note: rO is in the middle and f l,f2, and f3 form an equilateral triangle around rO. 
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The distance between fj and fj is square root of 3 (not quite 2), but the distance between rO 
and fj is 1. The multidimensional scaling would try to balance this, and so the causal map 
in D = 2 might be approximately 1.3 times the above, as shown below: 





dirnl 


dim2 


rO 


0 


0 


fl 


1.3 


0 


f2 


-0.65 


1.126 


f3 


^0.65 


-1.126_ 



Note: The distances between fj and fj are 2.252 and the distance between rO and fi is 1 .3. 
The coefficient is determined as follows: 

(rO, fi) = e^'-'^^^-^'0>r'r^)= eC-«*'-3'' 3) = e■'^^ since a ~ 1, then (rO, f; ) = 0.185. 

The matrix would then be: 

rO 

fl 0.185 
f2 -0.185* 
f3 0.185 

*The negative sign for factor f2 is applied by experience and indicates that an increase in 
the value of factor f2 produces a decrease in the response rO. 



TABLE 2 
Map Based Coefficients (Matrix A) 



knob 


Vth,n 


R s/d,n 


Leff,n 


Vth,p 


R s/d,p 


Leff,p 


1 XterW 




-0.107888 






-0.107888 




2 12 damage 




0.025962 










3 VNI 


-0.221786 












4 VPI 








0.221786 






5 GateOx QT 


0.137194 




-0.137194 








6 Gate Ox 


0.246187 




-0.246187 








7 PolyThk 


0.116432 


0.119731 




-0.116432 


0.119731 




8 G N2.I2 


-0.052234 




-0.104468 








9 SiOn Dap 






0.065866 






0.065866 


10 G Mask QT 






0.060969 






0.060969 


1 1 G stp 






0.158818 






0.158818 


12 SiON strip 






-0.064624 






-0.064624 


13LDCn 


-0.179057 




-0.196067 








14LDCp 








0.179057 




-0.196067 


15 LDD n 




-0.227165 


-0.166824 








16 LDD p 










-0.227165 


-0.166824 


17 UDOXl 




0.082092 






0.082092 




18IOX 




0.025134 






0.025134 




1 9 spacer Thk 




0.108862 


0.109174 




0.108862 


0.109174 


20 spacer o/e 




-0.152447 


-0.108867 




-0.152447 


-0.108867 


21 spacEtchEnt 














22 UDOX2 




0.026926 






0.026926 




23 RpdepThk 




-0.10924 






-0.10924 




24 RTAsd 


-0.202057 


-0.113617 


-0.069277 


0.202057 


-0.113617 


-0.069277 


25 RPE o/e 




-0.107437 






-0.107437 
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a es, 

u 



m 

E 

U 



10 



15 



20 



25 



26 Co QT 


0.109251 


0.109251 


27 Co Thk 


-0.1 131 16 


-0.1 131 16 


zo s cide Kl Al 


-U. I looo/ 


-U. 1 1 DOO / 


Zy s Clue rv I /\z 


-U. 1 lOoO / 


-yj. I 1 uovj / 


30 LI Thk 


-0.096417 


-0.096417 


31 polish Thk 


0.09219 


0.09219 


32 LI DICD 


-0.87249 


-0.087249 


33 LI alignX 


0,078742 


0.078742 


34 LI alignY 


0.078742 


0.078742 


35 LI o/e 


0.106432 


0.106432 


36 BMDDepTh 


0.101266 


0.101266 


37 BMD PCII 


0.101964 


0.101964 



Note: Blanks (or zeros) indicate that a particular critical factor does not affect the particular 
response, i.e., there is no "cause-effect." 

After the map-based coefficients (Matrix A) are determined. Figure 2, Step F, 
214, k is set to 0 and the matrix Uk =(null, zero-row matrix), Figure 2, Step G, 216. 

An initial base design matrix, X, is established by statistician experts in the field. 
Figure 2, Step H, 218. The base design matrix X shows in a generic way the form of the 
design; it is generic in the sense that particular factors are not yet assigned to particular X- 
columns. 

Table 3 show two design alternatives, one design alternative is a "split-plot only 
design" and the other is an "interblock" design. The split-plot design varies factors only 
within the lot (block). The interblock design varies factors both from lot to lot and within 
lot. The former set of factors are conventionally termed skew factors, the latter are termed 
split factors. In each of the two design alternatives Lg and L'g are matrices as follows: 



30 



35 



L8 = 



+ - 
- + 



+ + - - 

- - + + 
+ - + + 

- ++ - 
+ + + + 



and L'g = 



- - - + 
+ - - - 

+ + - - 

- - + - 
+ - + + 

- + + + 
+ + + - 
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TABLE 3 



split-plot design 



interblock design 



— 


0000 


0000 


— 

0000 




0000 


0000 


0000 




0000 


0000 


0000 


[ Lg] 


000 0 


0000 


0000 




000 0 


0 00 0 


0000 




0000 


0000 


0000 




0000 


0000 


0000 




000 0 


0000 


0000 


0000 




0000 


00 00 


0000 




0000 


0 0 00 


0000 




0000 


0 000 


0000 




0000 


00 00 


0000 




0000 


0000 


0000 




0000 


0000 


000 0 




0 0 0 0 


0 0 0 0 


0000 




0000 


0000 


0000 


0000 




0000 


0000 


0000 




0000 


0000 


0000 




0000 


0000 


0000 




0000 


0000 


0000 




0000 


0000 


0000 




0000 


0000 


0000 




0000 


0000 


0000 




0000 


0000 


0000 


0000 




0000 


0000 


0000 




0000 


0000 


0000 




0000 


0000 


0000 




0000 


0000 


0000 




0000 


0000 


0000 




0000 


0000 


0000 







+ 0 - 


0 


+ 0 - - 


+ - 0 + 




+ 0 - 


0 


+ 0 - - 


+ - 0 + 




+ 0 - 


0 


+ 0 - - 


+ - 0 + 


[L«] 


+ 0 - 


0 


+ 0 - - 


+ - 0 + 




+ 0 - 


0 


+ 0 - - 


+ - 0 + 




+ 0 - 


0 


+ 0 - - 


+ - 0 + 




+ 0 - 


0 


+ 0 - - 


+ - 0 + 




+ 0 - 


0 


+ 0 - - 


+ - 0 + 


+ - 0 + 






- + 00 


0 + - - 


+ - 0 + 






- + 00 


0 + - - 


+ - 0 + 






- + 00 


0 + - - 


+ - 0 + 






- + 00 


0 + - - 


+ - 0 + 






- + 00 


0 + - - 


+ - 0 + 






- + 00 


0 + - - 


+ - 0 + 






- + 00 


0 + - - 


+ - 0 + 






- + 00 
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- + 0 + 


0 + - - 


- + 0 


+ 




- + 0 + 


0 + - - 


- + 0 


+ 




- + 0 + 


0 + - - 


- + 0 


+ 




- + 0 + 


0 + - - 


- + 0 + 




- + 0 + 


0 + - - 


- + 0 


+ 




- + 0 + 


0 + - - 


- + 0 


+ 




- + 0 + 


0 + - - 


- + 0 


+ 




- + 0 + 


-0 + 0 


0 - + 




0 - + + 




-0 + 0 


0 - + 




0 - + + 




-0 + 0 


0 - + 




0 - + + 




-0 + 0 


0 - + 




0 - + + 




-0 + 0 


0 - + 




0 - + + 




-0 + 0 


0 - + 




0 - + + 




-0 + 0 


0 - + 




0 - + + 





P is a permutation matrix and the matrix product XP constitutes a rearrangement 
of the columns X. The matrix A is a matrix of coefficients linking (linearly) the full 37 
dimensional space to the 6 dimensional intermediate variable space, (37 factors (first 
column) and 6 responses (column headings) Table 2). The established initial design 
matrix X does not associate particular factors with particular columns of X, but it does 
describe the overall patterns of the experiment, that is, how many split factors per block, 
how many skew factors per block, how many runs (wafers) per block. A block is a set of 
experimental runs (wafers) processed together (in semiconductor processing; a lot). Split 
factors are factors that take on at least two values within a given lot (block). Skew factors 
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are factors that take on different values from nominal (0), but are constant within the 
block. 

For any particular assignment of X-columns to factors one can compute a score. 
This score is related to a prediction of how spread out the eventual results (responses) 
measured on the wafers (runs, rows of X) are predicted to be. The better designs will have 
better (higher) scores. This number is calculated by assigning particular columns of X to 
particular factors, one-to-one, with no duplicate assignments and no factors left out. 

A list-to-list assignment, with a score about which assignments are worse or 
better, is known as "the traveling salesman problem." In the conventional description of 
the traveling salesman problem, a salesman needs to visit a list of cities once each and 
wants to minimize the driving time. In that context, a salesman has one list — of cites — 
and another list, the number 1, 2, 3, 4, and needs to assign each number to each city. 
Assigning 1 to city B means visit that city first, 2 to city D means visit that city second, 
and so on. Such an algorithm gives an X-column-to-factor assignment with the biggest 
score of any assignment considered. The R step/E step algorithm discussed below is one 
particular traveling-salesman-solving algorithm. 

Conceptually, if an assignment is made of X-columns and factors at random and if 
another random assignment is made, there is a 50% chance that a higher score would be 
obtained. If a third random assignment is made, there is a chance of 33% of achieving a 
higher score than the previous two assignments, etc. As can be appreciated, random 
guessing (R step) bogs down and offers no improvement after numerous tries. What is 
done is pick the best so far and see if, swapping just one pair of factors' X-columns 
achieves a higher score. Doing this one pair at a time for all pairs of factors is the done by 
the E algorithm discussed below and is repeated until all pairs have been examined 
without an improvement. 

The optimal design algorithm including the algorithm R(k) and the algorithm E(k) 
are run with k = k + 1. Figure 2, Step I, 220. Y(P) = (I-B(B'^B)-*B'^)[(X P)//U]A & 
Wynn's criterion is run. Note that the term (I-B(B^B)"*B^) is a projection matrix that 
acts to filter out effects correlated with B, leaving only effects not correlated with B, that 
is, it serves as a blocking function. B is a matrix of dummy variables representing the 
blocks. After Y(P) is defined, the algorithms R(k) and E(k) are run. R(k) is an algorithm 
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to choose the best of rir random column permutation matrices P. E(k) is an algorithm is to 
choose the best column permutation matrix P that is "near" a previous solution. (On the 
first iteration of algorithm E, the previous solution comes from algorithm R; thereafter, the 
previous solution comes from the last application of algorithm E.) Note that A//B means: 
"append the rows of B to the rows of A, with the rows of A on top. 

Wynn's criterion: If {yi: i = 1.. .n} denotes a set of k-dimensional points 
comprising a possible experimental design, and the nxn matrix C is defined with typical 
element c(i,j) = exp(-llyi-yjll^). Wynn's criterion is that a design {yi} is better when detC. 
is larger ("det" denotes the matrix determinant). If C is interpreted as a correlation matrix, 
det(C) represents the generalized variance, which Wynn's criterion maximizes. This is 
achieved by moving the points {yi: i=l . . .n} far from one another. 

C, such that C(i,j) = exp{-liyi-yjll^}. Distances among points {yi} are transformed 
into "correlations" as discussed above. The points {yi} are the rows of matrix Y(P). 

Algorithm R (k): 

Let X' denote the best current design, with criterion value c', which is a scalar and 
initially c' = -oo. 

Loop in r=l to Ur 



Randomly rearrange columns of base design matrix X, resulting in Xf 
Form Wf by adding to matrix Xr the rows of Uk-i 

Yr,=WrA 

Yr2 = [I-B(B^B)^B^]Y,i 

Cr= detC(Yr,) X detC(Y,2) 



if it is determined at 222, Figure 2, that > c' then X' = Xr and c'=Cr 
end Loop r. 

The function of algorithm R is to choose the best of Ur random column 
permutation matrices P. 
Algorithm E(k): 

Let X' denote the best current design, with criterion value c', the scalar from 
algorithm R. 

Label E: Nolmprovement-true 



X'' = X' 



c 



Loop in i=l to n-1 
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Loop in j =i+l to n 

Form matrix Xy by swapping columns i,j of X' 
Form Wij by adding to matrix Xy the rows of Uk-i * 

Ye,=WijA 

Ye2 = [I-B(B^B)^B^]Ye, 

Cy = detC(Yei) X detC(Ye2) 

If Cij > c", then X" = Xy and c" = Cy, Nolmprovement =false 
end Loop j 
end Loop i 

if Nolmprovement then STOP else go to Label E. 

Note L* If a factor with a strong factor is split, Yri & Yr2 are both more dispersed, 
hence larger criterion. If some factor is skewed instead, Yri is dispersed, but not Yr2. In 
this way this criterion gives double points for splitting strong factors. 

* Note 2: It is conventional practice for statisticians to term vertical elements as 
"columns" and the horizontal elements as "rows." 



Tables 4-6 are examples of designs and solutions for particular 18- wafer lots 
and were extracted from a larger solution of 6-8 lots. Each design and solution, for 
example, the design and solution in Table 4 is a design Uk indicated at 224, Figure 2, 
Step !• 

After the optimal design algoritm is run Step I, Figure 2, 220 is run it is 
determined at 222 if the design Uk is large enough. If it is determined at 220 that there the 
design Uk is not large enough the flow returns to Step I and the optimal design algorith is 
repeated until it is determined at 222 that the design Uk is large enough. When this occurs 
the flow goes to Step J and the design experiment Uk is complete and the flow returns to 
Figure 1, Step D as indicated by arrow 226. 

When the flow returns to Step D, Figure 1, prototype wafers using the designed 
experiment are manufactured. As discussed above. Tables 4-6 each show 1 lot (18 
wafers) of a solution and design that could be 6-8 wafers. The manufactured prototype 
wafers are tested and model responses are measured at 114, Figure 1, Step E. 

It is determined at 116 whether the Model Responses are adequate. If the model 
responses are not adequate, the flow returns to Step I, Figure 2 as indicated by arrow 118. 
Step I, Figure 2 is the step of running the Optimal design algorithm and Steps I, Figure 2 
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through Step E, Figure 1 are repeated until it is determined at 116, Figure 1 that the 
model is adequate. 

After the model is determined to be adequate at 116, the tolerances are 
assessed/proposed at Step F, Figure 1, 120. Whether the proposed tolerances are 
5 manufacturable is determined at 122, Figure 1 and if the proposed tolerances are not 

manufacturable, the flow returns to Step B as indicated by arrow 126. The development 
of the idea then begins anew at Step B. If it is determined at 122, Figure 1 that the 
proposed tolerances are manufacturable, the best solution of the design is sent to 
production at Step G, Figure 1, 124. 

Table 4 is a lot (block) of 18 wafers and the total solution could be 6 - 8 lots. 
After a total number of lots is completed, the wafers are manufactured and tested to 
validate the experiment and to choose the best set of factors to use for full scale 
production. 

Table 4 is an example Split Sheet for one of 6 lots and is a part of a matrix [XP] 
and shows the results of running the optimization algorithm. A split sheet includes 
instructions for processing the wafers, of one particular lot (one block). Format is (XP)^: 
that is, the columns are wafers in a split sheet, arid the rows are factors. (Conventional 
experimental design notation has a reverse convention: the rows (the vertical elements) are 
wafers and the columns (the horizontal elements) are factors.) 

TABLE 4 

wafer #^ 1 2 3 4 5 6 7 8 9 10 1 1 12 13 14 15 16 17 18 

Factor 

1 XterW 0000000000 000 0 0 0 0 0 



25 2 12 damage 0 ------------ - - - - 0 <=** 

=>*3 VNI 0-++-- + + -+ -- ++ - - + 0 

4 VPI 0 ---------------- 0<= 

5 GateOxQT 0 - - - ------ 0<= 

6 GateOx 0 - - - ------ . . - _ _ _ _ o<= 

30 7 PolyThk 0 - - - ------ - - . . - . - 0<= 

=>8GN2I2 0--++-- + + - - - - + +0 

9 SiOnDep 000000000000000 000 

lOGMaskQT 0000 000000 0 000 0 00 0 

llGstp 000000000000000 000 

35 12 SiOn strip 0 ------------- - - - 0<= 

=> 1 3 LDC n 0- - -- -- -.+++ + + + + +0 

14 LDC p 0 ------------- - - - 0<= 

ISIox 00000000000 0000 000 

1 6 LDD n 0- + - + -+ -+ -+ - + - + - +0 

40 17 LDD p 0 - - - - - - - - - - - - - - - - 0<= 
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18 UDOXl 


0 0 0 


0 


0 


00 0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


19 spacer Thk 


0 0 0 


0 


0 


00 0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


20 spacer o/e 


0 - - 
























0 


=> 21 spacerEtchEnt 0 - + 


+ 




+ - - 


+ 




+ + 




+ 






+ 


0 


22 UDOX2 


00 0 


0 


0 


0 0 0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


23 RpdepThk 


00 0 


0 


0 


0 0 0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


=> 24 RTAsd 


0- - 






+ + + 


+ 








+ 


+ 


+ 


+ 


0 


25 RPE o/e 


00 0 


0 


0 


00 0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


26 Co QT 


00 0 


0 


0 


00 0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


27 Co Thk 


00 0 


0 


0 


00 0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 



28s'cideRTAl 0 - --------- 0<=: 

29s'cideRTA2 0- - - - o<= 

30 LI Thk 00000000 0000 00 0 0 00 

31polishThk 00000000 0000 00 0 0 00 

32LIDICD 0 ------------- - - - 0<= 

33 LI alignX 000000000000000 000 

34 LI alignY 000000000000000 000 

35 LI o/e 000000000000000 000 
36BMDDepThk0 0 0000000000000 000 
37 BMD PCII 000000000000000 000 



* The left-side arrows indicate, "split factors." 

** The right-side arrows mean that the factors varied in this lot for lot-to-lot experiment 
(skew factors). 

Note: In Tables 4-6, the "0" means that the factor has not been increased or decreased 
from the nominal value, that the means that the factor has been decreased and that the 
"+" means that the factor has been increased. 



Table 5 is a Split Lot with No Skewed Factors 



TABLE 5 



wafer # -> 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


14 


15 


16 


17 


18 


Factor 






































1 XterW 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


2 12 damage 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


3 VNI 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


4 VPI 


0 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


1 


1 


1 


1 


1 


1 


1 


1 


0 


5 GateOx 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


6 GateOx 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


7 PolyThk 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


8 GN2I2 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


9 SiOnDep 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


10 G Mask QT 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 1 G stp 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


12 SiOn strip 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


13LDC n 


0 


-1 


-1 


-1 


-1 


1 


1 


1 


1 


-1 


-1 


-1 


-1 


-1 


1 


1 


1 


0 


14 LDC p 


0 


-1 


1 


-1 


1 


1 


-1 


1 


-1 


1 


-1 


1 


-1 


-1 


1 


-1 


1 


0 


15 lox 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


16LDDn 


0 


-1 


1 - 


-1 


1 


-1 


1 


-1 


1 


-1 


1 


-1 


1 


-1 


1 


-1 


1 


0 


17 LDD p 


0 


-1 


-1 


1 


1 


1 


1 


-1 


-1 


1 


1 


-1 


-1 


-1 


-1 


1 


1 


0 


18 UDOXl 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


19 spacer Thk 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 
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20 spacer o/e 


0 


-1 


-1 


1 


1 


-1 


-1 


1 


1 


-1 


-1 


1 


1 


-1 


-1 


1 


1 


0 


21 spacerEtchEnt 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


22 UDOX2 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


23 RpdepThk 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


24 RTAsd 


0 


-1 


1 


1 


-1 


-1 


1 


1 


-1 


1 


-1 


-1 


1 


1 


-1 


-1 


1 


0 


25 RPE o/e 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


26 Co QT 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


27 Co Thk 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


28 s'cide RTAl 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


29 s'cide RTA2 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


30 LI Thk 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


31 polishThk 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


32 LI DICD 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


33 LI alignX 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


34 LI alignY 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


35LI o/e 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


36 BMD DepThkO 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


37 BMD PCII 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 



Lii 



20 



25 



30 



35 



40 



45 



50 



55 



Table 6 is a Split Lot that includes skewed factors. 



TABLE 6 



wafer # -> 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


14 


15 


16 


17 


18 


1 XterW 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


2 12 damage 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


3 VNI 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


4 VPI 


0 


-1 






























-1 


0 


5 GateOxQT 


0 


-1 






























1 


0 


6 GateOx 


0 


-1 






























-1 


0 


7 PolyThk 


0 


-1 






























-1 


0 


8 GN2I2 


0 


-1 






























1 


0 


9 SiOnDep 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


10 G Mask QT 


0 


-1 


1 


-1 


1 


-1 


1 


-1 


1 


-1 


1 


-1 


1 


- 1 


1 


-1 


1 


0 


1 1 G stp 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


12 SiOn strip 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


13LDC n 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


14 LDC p 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


15Iox 


0 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 - 


1 


- 1 


-1 


-1 


-1 


0 


16LDDn 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


17 LDD p 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


18 UDOXl 


0 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 - 


1 


- 1 


-1 


-1 


-1 


0 


19 spacer Thk 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


20 spacer o/e 


0 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 - 


1 


- 1 


-1 


-1 


-1 


0 


21 SpacerEtchEnt 0 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 - 


1 


- 1 


-1 


-1 


-1 


0 


22 UDOX2 


0 


-1 


-1 


-1 


-1 


-I 


-1 


-1 


-1 


-1 


-1 


-1 - 


1 


- 1 


-1 


-1 


-1 


0 


23 RpdepThk 


0 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 - 


1 


- 1 


-1 


-1 


-1 


0 


24 RTAsd 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


25 RPE o/e 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


26 Co QT 


0 


-1 


-1 


-1 


-1 - 


1 


-1 


-1 


-1 


-1 


1 


1 


1 


1 


1 


1 


1 


0 


27 Co Thk 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


28 s'cide RTAl 


0 


-1 


-1 


-1 


-1 - 


•1 


-1 


-1 


-1 


-1 


-1 


-1 


-I 


-1 


-1 


-1 


-1 


0 


29 s'cide RTA2 


0 


-1 


-1 


-1 


-1 - 


■1 


-1 


-1 


-1 


-1 


-1 


-1 • 


-1 


-1 


-1 


-1 


-1 


0 


30 LI Thk 


0 


-1 


-1 


-1 


-1 - 


1 


-1 


-1 


-1 


-1 


-1 


-1 - 


-1 


-1 


-1 


-1 


-1 


0 


31 polishThk 


0 


-1 


1 


1 


-1 


1 


-1 


-1 


1 


-1 




1 


-1 


1 


-1 


-1 


1 


0 



18 



Attorney Docket No. F0019 



PATENT 



32 LI DICD 


0 


0 


0 


0 


0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


33 LI alignX 


0 


0 


0 


0 


0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


34 LI alignY 


0 


0 


0 


0 


0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


35 LI o/e 


0 


-1 


1 


1 


-1 


-1 


1 


1 -1 


1 


-1 


-1 


1 


1 


-1 


-1 


1 


0 


36 BMD DepThkO 


0 


0 


0 


0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


37 BMD PCII 


0 


-1 


-1 


-1 


-1 


-1 


-1 


-1 -1 


-1 


-1 


-1 


-I 


-1 


-1 


-1 


-1 


0 



In summary, the described invention thus provides a method for a systematic 
approach to forming experimental designs for large, complex systems after an idea for a 
product is formed. 

The foregoing description of the embodiment of the invention has been presented 
for purposes of illustration and description. It is not intended to be exhaustive or to limit 
the invention to the precise form disclosed. Obvious modifications or variations are 
possible in light of the above teachings. The embodiment was chosen and described to 
provide the best illustration of the principles of the invention and its practical application 
to thereby enable one of ordinary skill in the art to utilize the invention in various 
embodiments and with various modifications as are suited to the particular use 
contemplated- All such modifications and variations are within the scope of the invention 
as determined by the appended claims when interpreted in accordance with the breadth to 
which they are fairly, legally, and equitably entitled. 



19 



